STORAGE CAPACITY OF EXTREMELY DILUTED HOPFIELD MODEL
نویسندگان
چکیده
منابع مشابه
On the Maximum Storage Capacity of the Hopfield Model
Recurrent neural networks (RNN) have traditionally been of great interest for their capacity to store memories. In past years, several works have been devoted to determine the maximum storage capacity of RNN, especially for the case of the Hopfield network, the most popular kind of RNN. Analyzing the thermodynamic limit of the statistical properties of the Hamiltonian corresponding to the Hopfi...
متن کاملCapacity of the Hopfield model
For a given 0 < δ < 2 if [Nδ] neurons deviating from the memorized patterns are allowed, we constructively show that if and only if α(δ) := p(N)/N = (1 − 2δ)2/(1 − δ)2 all stored patterns are fixed points of the Hopfield model. If [NδN ] neurons are allowed with δN → 0 then αN = (1−2δN )2/(8−1(1−δN ))2 → 0 where 8 is the distribution function of the normal distribution. The result obtained by A...
متن کاملStorage Capacity of Letter Recognition in Hopfield Networks
Associative memory is a dynamical system which has a number of stable states with a domain of attraction around them [1]. If the system starts at any state in the domain, it will converge to the locally stable state, which is called an attractor. In 1982, Hopfield [2] proposed a fully connected neural network model of associative memory in which patterns can be stored by distributed among neuro...
متن کاملInformation capacity of the Hopfield model
The information capacity of general forms of memory is formalized. The number of bits of information that can be stored in the Hopfield model of associative memory is estimated. It is found that the asymptotic information capacity of a Hopfield network of N neurons is of the order N3 b. The number of arbitrary state vectors that can be made stable in a Hopfield network of N neurons is proved to...
متن کاملThe storage capacity of the Hopfield model and moderate deviation principles
This note relates the storage capacity of the Hopfield model of neural networks to the existence of a moderate deviation principle for the empirical correlation of the patterns. This moderate deviation principle is satisfied under a certain condition on the moment generating function of these correlations which on the other hand can be verified in many cases by GHSand FKG-type inequalities. Exa...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: International Journal of Modern Physics C
سال: 2004
ISSN: 0129-1831,1793-6586
DOI: 10.1142/s0129183104005802